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Abstract 


The  theory  of  cumulative  processes,  introduced  and  developed  by 

W.  L.  Smith,  provides  a  significant  generalization  of  the  renewal  counting 

process.  We  examine  the  question  of  extending  the  Blackwell  and  key  renewal 

theorems  to  cumulative  processes.  For  a  subclass  of  cumulative  processes, 

which  we  call  strongly  cumulative,  the  Blackwell  and  key  renewal  theorems 

hold  under  very  general  conditions.  This  class  of  cumulative  processes 

includes  all  the  standard  examples  of  cumulative  processes.  We  also  study 

t 

processes  of  the  form  /(t)  ■  /  V(s)ds  where  V  is  a  regenerative  process. 

0 

Smith  has  shown  that  under  mild  conditions  V(s)  converges  in  distribution, 

say  to  V(»),  as  s  ■*  »,  and  that  f(t)/t  converges  almost  surely  and  in 

expectation  to  Kj/Uj  (a  constant).  Our  result  is  that  iCj/Uj  ■  EV(»). 

This  holds  even  if  lim  EV(t)  does  not  exist. 

t-*» 


Introduction 

Cumulative  processes  were  introduced  and  the  theory  developed  in  an 

elegant  paper  of  W.  L.  Smith  [4],  The  essential  structure  of  a  cumulative 

N(t) 

process,  (Y(t),  t  ^  0},  is  given  by  Y(t)  ■  £  Y^  ♦  W(t),  where  N(t) 

is  the  renewal  counting  function  of  an  embedded  renewal  process, 

if.  *  If (T. )  -  Y(T.  ,)  where  T.  is  the  time  of  the  i**1  renewal,  and 
1  v  v  v  1-1'  1 

W(t)  *  Y(t)  -  Y(Tn  ).  If  assumptions  are  introduced  which  insure  that  the 
*t 

sequence  {Y^}  is  i.i.d.  and  W(t)  is  small  compared  to  Y(t)  for  t 
large,  then  for  t  large  Y(t)  behaves  like  a  random  sum  of  i.i.d.  random 
variables,  and  one  can  exploit  this  structure  to  obtain  asymptotic  properties 
of  f(t).  Smith  derived  conditions  for  almost  sure  and  Lj  convergence  of 
Y (t)/t,  as  well  as  asymptotic  normality  of  t~*^(Y(t)  -  t/pj). 

Letting  Y (t)  ■  N(t)  (in  which  case  Y^  =  1  and  W(t)  =  0)  it  is 
seen  that  renewal  counting  processes  are  a  special  case  of  cumulative  processes. 
One  can  thus  view  Smith's  results  as  generalizations  to  cumulative  processes 
of  theorems  concerning  renewal  counting  processes.  In  this  context  it  is  of 
interest  to  examine  the  possibility  of  extending  the  blackwell  and  key 
renewal  theorems,  which  are  results  of  great  importance  for  renewal  counting 

processes,  to  cumulative  processes.  In  section  1  we  show  that  for  a  slightly 

% 

restricted  class  of  cumulative  processes,  the  above  theorems  hold  if 
the  expected  total  variation  of  Y  over  a  renewal  cycle,  is  finite.  The 
restricted  class  which  we  consider  is  characterized  by  a  stronger  regeneration 
property  at  renewal  epochs  than  that  defined  by  Smith.  To  our  knowledge  this 
class  of  cumulative  processes  includes  all  the  standard  examples  of  cumulative 


processes. 
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In  section  2  we  consider  cumulative  processes  of  the  form 
t 

Y(t)  ■  /  V(s)ds,  where  V  is  a  real  valued  regenerative  process.  An 
0 

important  result  of  Smith  is  that  Y(t)/t  converges  almost  surely  and  in 
expectation  to  Kj/Wj,  where  x^  is  the  expected  value  of  the  integral 
of  V  over  a  regeneration  cycle,  and  pj  is  the  expected  length  of  a 
regeneration  cycle.  Our  result  is  that  Xj/y^  *  EV(»)  where  V(»)  has 
the  limiting  distribution  of  V(t). 


1.  Define  {X-.X^,...}  to  be  a  generalized  renewal  sequence  if 
are  proper  (Pr(X^  <  «>)  ■  1)  non-negative  independent  random  variables,  and 
{Xj,X2»...}  are  identically  distributed.  Without  loss  of  generality  assume 
that  Pr(Xj  *  0)  *  0.  Let  {Y(t),  t  >  0}  be  a  real-valued  stochastic 

process.  Define  ^(t)  to  be  the  total  variation  of  Y  over  [0,t],  Assume 

% 

that  Y (t)  <  «  a.s.  for  all  t.  Define: 


(i)  y,  *=  EX  (possibly  ♦«) 

1  1  n-1 

(ii)  T  *  0,  T  =  T  X. ,  n  ■  1,2,... 

0  n  jio  1 

(iii)  N(t)  -  k  iff  Tk  i  t  <  Tk+1 

(iv)  m(t)  «  E(N(t)) 

(v)  Yn  =  Y(Tn+1)  -  Y(Tn),  n  -  1,2,... 

(vi)  Yn  =  Y(Tn+1)  -  Y(Tn),  n  ■  1,2,... 

(vii)  Kj  =»  EY1  (possibly  +«),  x^  ■  EY^  (if  it  exists). 


Smith  defines  a  real  valued  process  (Y(t),  t  >  0}  to  be  cumulative 
if  it  satisfies: 

(Cl)  {YjjYj,...}  are  i.i.d.  random  variables. 

(C2)  Y(t)  <  »  a.s.  for  all  t. 

(C3)  {Yj,Y2#..«)  are  i.i.d.  random  variables. 

Given  a  process  Y  and  a  generalized  renewal  sequence  {Xq^,...}, 
define  the  process  (Y'(t),  t  ^  0}  by: 

<Y'(t)  «  Y(X0  ♦  t)#  t  >  0} 

Similarly  define  (Y1 (t),  t  >0}.  Define  a  process  Y  to  be  strongly  cumula¬ 
tive  if  Y  satisfies  (C2)  and  condition  (Cl')  given  below: 

(Cl')  Pr (Y (t)  -  Y(T  )  e  A| initial  conditions,  X  <  t, 

wt  u  - 

(Y(x) ,  x  <  T  },  T  -  s)  -  Pr(Y'(t-s)  -  Y'(0)  e  A  |  X  >  t-s)  for 
t  t 

all  t  >_  0  and  Borel  sets  A. 

Condition  (Cl*)  asserts  that  given  T  and  X»  <  t,  Y(t)  -  Y(TN  ) 

is  conditionally  independent  of  the  initial  conditions  and  of  the  history  of 

the  processes  until  TN  .  Moreover,  this  conditional  distribution  depends  on 

Nt 

t  and  Tn  only  through  t  -  TN  .  The  initial  conditions  refer  to  the  joint 
Nt  t 

distribution  of  XQ  and  (Y(t),  t  ^XQ}.  Condition  (Cl*)  is  closely  related 
to  Smith’s  definition  of  a  regenerative  process,  (4]  p.  13. 
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It  follows  immediately  that  (Cl1)  implies  (Cl)  and  (C3).  To  see  that 
(Cl)  and  (C3)  do  not  imply  (Cl'),  let  Xg  ■  0,  =  1  i  >  0,  and  choose 

fj  and  f^  on  [0,1]  such  that  f^  /  f2>  fj  and  f2  both  have  total 

variation  1  on  [0,1]  and  f^(0)  ■  f^(l)  »  0,  i  ■  1,2. 

fj(ct),  if  [t]  is  even  and  t  -  [t]  ■  a 

Define  Y(t)  *  . 

f2(a),  if  [t]  is  odd  and  t  -  [t]  ■  a 

Then  Y  is  cumulative  but  not  strongly  cumulative.  It  was  this  type  of 
example  which  led  us  to  define  strongly  cumulative  processes,  since  in  dealing 
with  asymptotic  local  behavior  of  Y(t),  it  is  convenient  to  have  the  entire 
probabilistic  structure  of  Y  the  same  for  each  renewal  interval,  rather 
than  merely  having  increments  (Y(Tn)  -  Y(Tn  p,  Y(Tp  *  Y(Tn_p) 
identically  distributed. 

Since  we  will  be  generalizing  and  using  the  Blackwell  and  key  renewal 
theorems,  we  state  them  here  for  convenience.  The  Blackwell  and  key  renewal 
theorems  are  equivalent  ([2],  p.  349). 

Lemma  1.  Blackwell's  theorem.  [2]  p.  347.  Let  {Xg,X^,...}  be  a 
generalized  renewal  sequence,  with  F  non-lattice.  Then  lim  m(t+h)  -  m(t)  * 
h/uj  for  all  h  (if  y^  *  «,  1/y^  *  0). 

Lemma  2.  Key  renewal  theorem  (Smith,  Feller),  [2],  p.  349,  Let  {Xq,Xj,,..} 

be  a  generalized  renewal  sequence  with  F  non-lattice,  and  z  directly 

Riemann  integrable  (for  all  e  >  0  3  h  >  0  )h  <  h'  h  £  (  sup  z(x)  - 

n  xe[(n-l)h,nh) 

t  ,  * 

inf  z(x)  <  e).  Then  lim  /  z(t-x)m(dx)  *  —  /  z(x)dx  . 
xe[(n-l)h,nh)  t+®  0  W1  0 
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We  note  that  a  function  on  [0,°°)  which  is  of  bounded  variation  and 
integrabie  is  directly  Riemann  integrable.  This  follows  easily  from  example 
(b)  p.  349  of  Feller  [2], 


Theorem  1.  Blackwell  theorem  for  strongly  cumulative  processes.  Suppose 
Xq  «  0,  and  {X1#X2,...}  is  a  renewal  sequence.  Let  {Y(t),  t  >_  0}  be 
strongly  cumulative  relative  to  {X^,X2,...}.  Then  if  F  is  non-lattice 

K1 

and  k  <  «  then  lim  E(Y(t+h)  -  Y(t))  *  h  —  for  all  h. 

1  t-*»  U1 


Proof.  If  we  define  Y*(t)  *  Y(t)  -  Y(0)  for  t  ^  0,  then  Y*  is  strongly 
cumulative  and  Y*(t+h)  -  Y*(t)  ■  Y(t+h)  -  Y(t).  We  therefore  can  assume 

<v 

that  Y(0)  ■  0  without  loss  of  generality.  Note  that  iCj  <  *  ->  exists. 

Also  E|Y(t)|  <  EY(t)  1EY(Tn  +1)  *  KjOnCt)  ♦  1)  by  Wald's  identity  (Nt+1 

*  <v> 

is  a  stopping  time),  and  therefore  EY(t)  exists  for  all  t. 

Define  R(t)  ■  Y(TN  -  Y(t),  for  t  ^  0.  Similarly  define  R'  for  the 
Y'  process.  Now: 


E(Y(t+h)  -  Y(t)) 


(1) 


Nfh+1  V1 

E(  l  Y  -  l  Y  ♦  (R (t+h)  -  R(t ) ) 
1  1  1  1 

Kj(m(t+h)  -  m(t))  +  E(R(t+h)  -  R(t))  . 


By  lemma  1,  lim  (m(t+h)  -  m(t))  ■  h/y.,  and  thus  theorem  1  will  be  proved 
t-x*>  1 

upon  showing  that  lim  E(R(t+h)  -  R(t))  *  0. 

t-K» 


All  integrals  below,  unless  otherwise  specified,  are  taken  over  closed 


intervals.  Now: 


t 

(2)  ER(t)  -  /  m(dx) (1  -  F(t-x))E(R‘ (t-x)  |X  >  t  -  x) 

0  1 


t  » 

•(3)  /  m(dx)  /  E (R *  (t-x)  |X.  -  s)F(ds) 

0  (t-x)  1 


Expression  (2)  is  obtained  by  conditioning  on  TN  .  Using  expression  (3)  it 

Nt 

follows  that: 


(4)  E(R(t)  -  R(t+h))  -  a(t)  +  b(t)  -  c(t)  -  d(t)  ♦  e(t) 


where 


t  ® 

(5)  a(t)  -  /  m(dx)  /  E (Y* (t-x+h)  -  Y'(t-x)|X.  -  s)F(ds) 
0  (t-x+h)  1 


t  (t-x+h) 

(6)  b(t)  -  /  m(dx)  /  E(Y'|X  -  s)F(ds) 

0  (t-x) 


t  (t-x+h) 

(7)  c(t)  »  /  m(dx)  /  E(Y'(t-x)|X.  «  s)F(ds) 

0  (t-x)  1 


t+h  ® 

(H  d(t'  •  /  m(dx)  /  E(Y'|X.  -  s)F(ds) 

t+  (t-x+h) +  1  1 

t+h  ® 

e(t)  «  /  m(dx)  /  E(Y' (t-x+h) |X.  *  s)F(ds) 

,+  (t-x+h) 


l 


(9) 


We  will  show  that  each  of  a,  b,  c,  d,  e  converges  as  t  -*• 
the  limits. 


and  evaluate 


(i) 

o(x) 


It  follows  from  (5)  that 


00 


t 


a(t)  «  / 
0 


s)F(ds). 


a(t-x)m(dx) 


where 


Define  Z(x) 


Y»(x),  x  <  maxCXj  -  h,  0) 


Y*  (Xj),  x  ^max^  -  h,  0) 


Then  a(x)  »  E(Z(x*h)  -  Z(x)) 


and  the  total  variation  of  Z  on  [0,»)  does  not  exceed  YJ.  Let  »  be  a 
partition  of  [0f°0«  Now: 


I|a(x.)  -  a(x  )|  <  l  E|Z(x  )  -  Z(x  )  ♦  [  E|Z(x  *h)  -  Z(x  *h)| 

XjCir  x^cir  x^+hcif+h 

2£j  <  »  . 


Therefore  a  is  of  bounded  variation.  Moreover  ^  |a(x)|dx  ■  ^  E|Z(x+h)  - 
00 

Z(x)|dx  <_  2  /  E|Z(x)|dx  <_  2k.,  Therefore  a  is  of  bounded  variation  and 
0 

integrable,  a.td  thus  directly  Riemann  integrable.  Applying  lenna  (2)  we  obtain: 


.  00  00 

(10)  lim  a(t)  -  i-  /  J  E(Y'(x+h)  -  Y'(x)|X  -  s)F(ds)  «  a 
t-*»  W1  x-0  s»(x*h)  1 


t 

(ii)  It  follows  from  (6)  that  b(t)  ■  /  B(t-x)m(dx)  where 

0 

x+h 

B(x)  -  /  ECY'IX,  -  s)F(ds)  . 

*  1 
x 


8- 


Now  letting  G(x)  ■  /  E(Y*  | X.  ■  s)F(ds)  we  see  that  G  is  the  c.d.f.  of  a 

0  1  1 

finite  signed  measure  (since  E|  Y£  |  <  ®)  and  is  therefore  of  bounded  varia¬ 
tion.  Since  g(x)  ■  G(x+h)  -  G(x),  g  is  also  of  bounded  variation.  Also 
00  ®  x+h  h 

J  |B(x)|dx  <  J  /  E(|Y*|  X  -  s)F(ds)  <.  /  sE(|Y'|  X  -  s)P(ds)  ♦ 

0  “Ox11  0  1  1 

m 

|  hE(|Yj|  Xj  ■  s)F(ds)  <_  hlcj.  Therefore  g  is  directly  Riemann  integrable. 
By  lemma  (2): 


lim  b(t) 

t-H» 


J  sE(Y'|X  -  s)F(ds)  ♦  jLj  E(Y'|X  -  s)F(ds) 
"lO  11  “lh  11 


(iii)  It  follows  from  (7)  that  c(t)  ■  J  Y(t-x)n(dx)  where 

0 

x+h 

y(x)  -  J  E(Y' (x) | Xj  -  s)F(ds). 


Define:  L(x) 


Y*  (x),  max(0,  Xj  -  h)  <_  x  <  Xj 


,  x  <  max(0,Xj  -  h),  x  >_  Xj 


.  Then  y(x)  ■  EL(x), 


and  the  total  variation  of  W  on  [0,*)  does  not  exceed  2YJ.  Therefore 
Y  is  of  bounded  variation.  It  is  easily  shown  that  y  is  integrable. 
Again,  then,  by  lemma  2: 


.  ®  x+h 

lim  c(t)  ■  J  dx  /  E(Y'(x)|X  -  s)F(ds)  ■  c  . 

t-*»  W1  0  x+  1 
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(iv) 

«(x) 


It  follows  from  (8)  that  d(t) 

CO 

■  [/  E(Yj|X,  -  s)F(d«)]l|Jjh) 

X 


r 


t+h 

J  6(t+h-x)m(dx) 
0 


where  I 


(x) 

[0,h) 


where 

1  0  x  < 

0  x  >  h, 


h 


x  <  o 


f  X 1 

Now  6(x)  *  (1  -  G(x))Ijg  the  product  of  two  functions  of  bounded  variation. 
Therefore  6  is  of  bounded  variation,  and  is  bounded  and  vanishes  outside  a 
bounded  interval  and  therefore  integrable.  Using  lemma  (2)  wc  thus  obtain: 


(13)  limd(t)  »  /  sE(Y'|X  «  s)F(ds)  ♦  ^-  /  E(Y* | X.  =  s)F(ds)  =  d 

t-*o  M1  s=0  11  U1  u+  1  1 

n 


t+h 

(v)  From  (8)  e(t)  ■  /  m(dx)e (t+h-x)  where 

0 

00 

e (x)  «  [/  E(Y'(x)|Xj  =  s)F(ds)] l|g^h)  *  BY  now  familiar  arguments  e  is 
x+ 

directly  Riemann  integrable  and: 

.  h  °° 

(14)  lim  e(t)  -  ±-  /  dx  /  E(Y*  (x)|X.  «  s)F(ds)  =  e 

t-*»  0  +  1 

x 

Note  that  a  -  c  +  e  ■  0  and  b  *  d  so  that  E(R(t)  -  R(t+h))  ■+  0  as 
t  +  «.  This  proves  the  result. 


Corollary  1,  Let  {Xq.Xj,...}  be  a  generalized  renewal  sequence,  FQ  the 
c.d.f.  of  Xq,  and  F  the  c.d.f.  of  X^.  Assume  that  (Y(t),  t  >_  0}  is 
strongly  cumulative  with  respect  to  (Xq.X^...).  Then  if  F  is  non-lattice. 
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EYq  <  «,  and  <  »  then: 


lim  E(Y(t+h)  -  Y(t)) 


h-!- 


Proof.  Let  ht(x)  =■•  E(Y'(y-x+h)  -  Y*(t-x)).  Then: 


(15)  E(Y(t+h)  -  Y(t))  *  /  ht(x)F0(dx)  ♦  /  E(Y(t+h)  -  Y(t) |XQ  »  x)FQ(dx) 


Now  h  (x)  -*•  h  as  t  ■+  «  for  all  x  (lemma  1),  h«.(x)  >  0  for  all 

W1  ‘ 

t,  x,  and  sup  h  (x)  <_  EY*  CT")  ♦  h  —  ♦  1  where  T  is  chosen  so  that 
t.x  c  U1 

K . 

x  >  T  “^^(Y^x+h)  -  Y'(x))  -  h  — |  <  1.  Therefore  by  the  dominated  con- 

t  1  tc 

vergence  theorem  /  ht(x)FQ(dx)  •+  h  as  t  •+  »  .  Now 


/  E(Y(t+h)  -  Y(t)|X  -  x)F  (dx)  -  /  E(Y(t+h)  -  Y(t)  |X_  -  x)F  (dx) 

t+  U  £t+h)+  0  0 

t+h  t+h 

4  /  E(Y(t+h)|XQ  »  x)F0(dx)  -  /  E(Y(t)|X0  »  x)F0(dx) 

t+  t* 


and: 


(t 


|  00  f\j 

!  E(Y(t+h)  -  Y(t)(X  «  x)F  (dx)  <  /  E(Y  |X  *  x)F  (dx)  •+  0 

+h)  u  u  |  -  (t+h)*  o  u  o 


as  t  •*  «  since  EYQ  <  00  . 
t+h 


/  E(Y(t+h)|X0  =  x)F0(dx)  <_  E?'(h)(F  (t+h)  -  F  (t))  -  0 


as  t  ■+ 


t+h 

/  E(Y(t)|XQ 


t+h 


x)F0(dx)  <  /  F(Y  |X  =  x)F  (dx) 

+  w 


■+  0  as  t  -+  «. 
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In  Corollary  1  we  iirpose  the  condition  EYp  <  ».  An  uncontrived  example 

which  shows  that  this  condition  is  not  necessary  is  obtained  by  defining 

{Y(t)  =  t,  t  >  0}.  In  this  case  YQ  =  Xp.  Choose  X,  such  that  E | X^  |  <  «>, 
2 

EXj  *  oo,  and  let  Xp  be  distributed  according  to  the  equilibrium  excess 

1  *,  a, 

life  distribution  of  X.(Fp(x)  *  — /  (1  -  F(s))ds).  Then  EYn  *  ®  but 


E(Y (t+h)  -  Y(t))  =  h  •  h  . 


'1  0 


In  the  general  strongly  cumulative  case  with  F  non-lattice  and 
Kj  <  «,  the  conclusion  of  theorem  1  need  not  hold.  For  example,  define 
f Y (t)  --  At,  t  <_  Xp}  for  t  <_  Xp,  v/here  A  is  a  random  variable  with 

E | A |  «=  «,  and  choose  XQ  such  that  Pr(Xp  >  x)  >  0  for  all  x.  Distribute 

{ Y (t )  -  Y (Xp) ,  t  >  Xp)  as  any  strongly  cumulative  process  (Y'(t),  t  ^  0} 
with  X^  ■  0.  Then  the  process  (Y(t),  t  ^  0}  will  be  strongly  cumulative, 
but  EY (t)  will  not  exist  for  any  t. 

For  an  important  class  of  strongly  cumulative  processes,  the  conclusion 


of  theorem  1  holds  without  regard  to  whether  or  not  EYp  <  °».  This  class  is 
obtained  by  treating  the  point  0  as  a  random  point  in  a  renewal  interval. 

We  assume  that  the  last  renewal  at  or  prior  to  0  occurred  at  the  point  -T, 
where  T  is  a  non-negative  random  variable  with  c.d.f.  G.  Moreover  we 
assume  that: 


(C4)  { Y(-T+t)  -  Y(-T),  t  >  0}  and  { Y* (t)  -  Y»(0),  t  >  0} 


are  identically  distributed 
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Since,  E(Y(t*h)  -  Y(t))  «  /  C.*(dx)E(Y*  (t+x+h)  -  Y'(t*x)),  if  F  is  non-lattice 
*  0 

and  <1  <  ®,  we  can  apply  the  dominated  convergence  argument  of  Corollary  1 
to  obtain  the  conclusion.  Thus: 

Corollary  2.  If  {Y(t),  t  >_  0}  is  strongly  cumulative  and  satisfies 
condition  (C4),  then  if  F  is  non-lattice  and  <  ®,  then 

K1 

lim  E(Y (t+h)  -  Y(t))  *  h  —  . 
t-*»  U1 

As  is  shown  in  Feller  ([2],  p.  349)  lemmas  1  and  2  are  equivalent. 

Moreover,  Feller's  argument  carries  over  verbatim  to  the  cumulative  case. 

Thus: 

Corollary  3.  Under  the  conditions  in  theorem  1  or  of  Corollaries  1  or  2, 

if  z  is  directly  Riemann  integrable  then  lim  /  z(t-x)m(dx)  ■  —  /  z(x)dx. 

t-*»  0  P1  0 

Moreover,  for  strongly  cumulative  processes  the  Blackwell  and  key  renewal 
theorems  are  equivalent. 

2.  Define  G  to  be  the  class  of  all  probability  distributions  on  [0,®) 
having  the  property  that  for  some  k,  the  kth  convolution  of  F  with  itself 
has  an  absolutely  continuous  component. 

Let  {Xq,Xj,,..}  be  a  generalized  renewal  sequence  and  (V(t),  t  >_  0) 
an  (X,A)  valued  stochastic  process,  where  X  is  a  set  and  A  a  o-algebra 
of  subsets  of  X.  Define  {V'(t)  ■  V(Xg+t),  t  >_  0).  A  process  V  is 
defined  by  Smith  [4],  p.  13,  to  be  regenerative  if  Pr(V(t)  c  A| initial 
conditions,  XQ  <_  t,  {V(x),  x  <  TN  ),  T^  =  s)  =  Pr(V'(t-s)  e  A  |  X1  >  t-s)  for  all 
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t  >_  0,  A  e  A.  Smith  has  shown,  [3],  p.  259,  that  if  V  is  regenerative, 
F  e  G,  and  pj  <  ™,  then 

1  ® 

(16)  lim  Pr (V(t)  e  A)  =  ~f  Pr(V»(t)  e  A,  X.  >  t)dt  =  p  (A) 

u,  ‘  1  ® 

t-*»  1  0 

for  all  A  e  A. 


It  follows  from  Fubini's  theorem  that  p  is  a  probability  measure  on  (X,A). 


Suppose  that  V  is  a  real-valued  regenerative  process  with  a  measurable 

t 

modification,  satisfying  /  E|V(s)|ds  <  «  for  all  t.  Define 
t  0 

{ Y (t )  ■  /  V(s)ds,  t  >_  0}.  It  follows  easily  that  Y  is  strongly  cumulative. 

0  *  xi 

Smith,  [3],  p.  262,  has  shown  that  if  tc  =  E  /  |V'(s)|ds  <  then  Y(t)/t  * 

1  t  <1  1  0 

—  /  V(s)ds  —  a.s.  in  expectation  as  t  -*•  °°.  In  view  of  this  result  and 
0  U1 

ao 

lemma  3  it  is  natural  to  conjecture  that  Kj/pj  =  EV(»)  e  /  xp^dx).  We 

•  CO 

will  prove  this  conjecture. 

It  will  be  convenient  to  convert  the  imbedded  renewal  process  into 
a  stationary  renewal  process.  This  is  done  by  inserting  a  renewal  to  the 
left  of  0,  its  distance  from  0  coinciding  with  the  asymptotic  distri¬ 
bution  of  t-T^  .  Formally,  we  let  {X?,  i  =  0,±1,...}  be  a  doubly 

infinite  sequence  of  i.i.d.  random  variables  distributed  as  X^.  Define 
n  -n 


Tn  "  X0  +  J  Xi  for  n  I  °»  T*  *  xq  -  I  for  n  <  0.  Then  {T*, 

n  »  0,±1,...}  generates  a  stationary  renewal  process  on  (-®,®)  (see  [1], 
p.  162).  Define  T^  as  the  first  T*  point  to  the  left  of  0.  Since  the 
process  {t-Tj*  ,  t  >_  0}  is  strictly  stationary  and  regenerative,  it  follows 
that  the  distribution  of  -T^  coincides  v.ith  the  limiting  distribution  of 
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t  -  TN  .  By  lemma  (3) 

(17)  Pr(-Tn  <  x)  -  t —  Jf  (1  -  F(s))ds 

U1  0 

We  introduce  a  process  (V*(t),  t  >_ T®},  defined  to  be  identically  distri 
buted  as  {V'(t  -  T°),  t  >_  0}.  Then  V*  is  a  strictly  stationary 
regenerative  process. 

Theorem  2.  Let  (V(t),  t  >_  0}  be  a  real-valued  regenerative  process 

possessing  a  measurable  modification  and  such  that  F  e  G,  u,  <  °°f  and 
t 

/  E|V(s) |ds  <  *  for  all  t.  Then 
0 

E|V(®)|  <  «>f  and  Kj  <  *  implies 
a.s.  and  in  expectation  as  t  ■+  ®. 


X  +X 

tc.  *  E  *  |V(s)|ds  <  «■  iff 
X0 

k  /u  =  EV(-)  and  i  /  V(s)ds  -  EV(«) 
i  l  z  o 


Proof. 


(18)  Pr (V* (0)  e  A)  =  —  /  Pr(V*(0)  e  A|T°  =  -t)  (1  -  F(t))dt 

,J1  t°0 


and 


(19)  Pr(V'(t)  e  A,  Xj  >  t)  =  Pr(V'(t)  e  A | Xj  >  t) (1  -  F(t)) 

=■  Pr (V* (0)  e  A|T°  =  -t)  (1  -  F(t)) 


thus  from  (16),  (18)  and  (19): 


(20) 


Pr(V*(0)  e  A) 


u  (A)  for  all  Borel  sets  . 

CO 
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V'(t), 


Define:  W(t)  * 


t  <_  XJ 


t  >  XJ 


Then  /|V'(s)|ds  *  /  |W(s)  |ds ,  possibly  both  +®.  Now: 

0  0 


E  /  |W(s) | ds  -  /  E|W(s)|ds  •  /  E(|V'(s,| 
0  0  0 


X'  >  s)  (1  -  F(s))ds 


-  /  E(  |V*(0)  )  T°  *  -s)  (1  -  F(s))ds  =  y.  E | V* (0)  |  =  u,E|vH 
0 

with  all  above  equalities  between  integrals  holding  when  the  value  of  any 

one  is  Thus  < ^  <  °°  iff  E|V(®)|  <  If  Kj  <  »  then  all  the  above 

equalities  hold  with  |w|,  jV*|,  |v|  and  |V*|  replaced  by  '.V,  V',  V  and 

,  t 

V*.  Thus  tc./y.  *  EV(®) .  By  this  equality  and  lemma  3,  -  /  V(s)ds  EV(®) 

ii  z  Q 

a.s.  and  in  expectation  as  t  <p. 


3.  Comments  and  Additions 


(i)  A  shot  noise  process,  is  a  process  of  the  form  X(t)  =  £  g(t  -  T^), 

where  g  is  a  real-valued  function  and  <T^,  i  *  0,1, 


. .  .> 


T.<t 


a  generalized 


renewal  sequence.  One  can  rewrite  X(t)  =  J  g(t-s)N(ds),  which  suggests 

0 

replacing  the  renewal  counting  process  N,  by  a  strongly  cumulative  process 
t 

Y,  with  X(t)  *  /  g(t-s)Y(ds).  Then,  if  Y  satisfies  the  conditions  in 
0 

either  corollary  1  or  2,  F  is  non-lattice  and  g  directly  Riemann  integrable. 

Km  00 

then  by  Corollary  3,  EX(t)  —  /  g(x)dx.  If  g(x)  *  e”Sx,  B  >  0, 

V1  0 

*1 

then  EX(t)  -*■  r —  .  The  exponential  form  for  g  is  usually  called  a 

BU  j 

discount  factor  and  is  used  in  models  where  Y(t)  represents  the  accumulation 
of  capital  until  time  t,  and  the  real  value  of  capital  is  assumed  to  decrease 
exponentially. 
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(ii)  Consider  n  positive  recurrent  irreducible  Markov  renewal  process  X, 


with  states  0,1,...  . 
epochs  t,  for  which 


We  let  the  imbedded  renewal  process  consist  of  the 


X(t')  +  0,  X(t)  =  0.  Define  V (t)  = 


0 

1 


X(t)  f  j 
X(t)  «  j  . 


Then  V  is  a  regenerative  process,  and  thus  if  F  e  G  Y(t)/t  » 

1  t 

—  /  V(s)ds,  the  proportion  of  time  spent  in  state  j  in  [0,t],  converges 
0 


a.s.  and  in  expectation  (theorem  2)  to  Pr(V(«)  »  j).  By  theorem  1, 


t*h 

F  /  V(s)ds  -►  hPr(V(®)  =  j).  Theorem  1  holds  with  F  non-lattice 
t 


and  in  this  case  theorem  2  will  also  hold  with  F  non-lattice. 


(iii)  In  the  following  example,  the  process  Y  satisfies  (Cl1),  does 

not  satisfy  (C2),  and  the  Blackwell  conclusion  does  not  hold.  Define 
jO  t  rational 

Y(t)  =  /  .  Let  X  =  0,  and  let  X  ,X-,...  have  a 

|  1  t  irrational  u  1  1 

non-lattice  distribution  concentrated  on  the  rationals.  Then  lim  E(Y(t  +  /3) 

Y  (t) )  =  1,  lira  E(Y(t  ♦  /3)  -  Y(t))  -  -1. 

(iv)  The  Wiener  process  satisfies  (Cl1)  (with  respect  to  arbitrary  renewal 
sequences  independent  of  the  process  itself),  does  not  satisfy  (C2),  but 
E(Y(t«-h)  -  Y(t)  h  o,  so  the  Blackwell  conclusion  holds. 

In  general,  consider  a  process  (Y(t),  t  >_  0}  satisfying  (Cl') 

with  existing.  Then  it  follows  from  (1),  that  a  necessary  and  sufficient 

*1 

condition  for  lim  E(Y(t+h)  -  Y(t))  =  —  h,  is  that  E(R(t*h)  -  R(t))  -*•  0 

t-«0 

as  t  -*■  ®.  A  sufficient  condition  is  that  lim  ER(t)  exist. 

t-w» 
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(v)  Consider  a  G •  I •  |G j s  queue,  1  <_  s  <_  «,  with  or  without  batch  arrivals. 
A  renewal  epoch  occurs  when  a  customer  initiates  a  busy  period.  For  parti¬ 
cular  queuing  models  conditions  are  available  under  which  ^  <  ®.  For 
example,  in  a  G*I»|G|s  queue  1  s  <  ®,  with  single  arrivals,  Wg/uA  <  1 
(expected  service  time/expected  interarrival  time)  is  sufficient.  If  either 
the  interarrival  time  distribution  or  service  time  distribution  is  non-lattice 
(belongs  to  G)  then  F  is  non-lattice  (belongs  to  G).  Some  interesting 
regenerative  and  cumulative  processes  are: 


(1)  Vj  (t )  ■  number  of  customers  in  queue  at  time  t.  Yj(t)  «  /  Vj(s)ds 

0 

total  waiting  time  of  customers  in  queue  during  [0,t]. 

I  1  if  j  customers  in  queue  at  time  t. 

(2)  V  (t)  -  ( 

\^0  i  j 

Y2(t)  ■  proportion  of  time  in  [0,t]  with  j  customers  in  the  queue. 


(3)  In  (1)  and  (2)  replace  customers  in  queue,  by  customers  receiving  service. 

(vi)  In  Theorem  (2),  F  e  G  can  be  replaced  by  F  non-lattice,  as  long  as 
the  class  of  sets  A  for  which  $^(t)  *  Pr(V'(t)  e  A,  >  t),  is  of  bounded 

variation  on  finite  intervals,  generates  the  Borel  sets.  This  follows  from 
Smith  [3],  p.  259. 


(vii)  Let  S  be  a  regenerative  process  with  state  space  (X,A)  and  possessing 
a  modification  which  is  jointly  measurable  as  a  map  from  (fi,C)x(R,g)  to  (X,A). 
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Here  (s;,C,P)  is  the  probability  space  on  which  each  S(t)  is  defined, 

R  =  [0,®),  6  the  Borel  sets  on  [0,®).  If  R  is  a  real-valued  Borel 
measurable  function,  then  (V(t)  =  R(S(t)),  t  >_  0}  is  a  real-valued 
measurable  regenerative  process.  If  <  ®,  F  e  G,  then  since 
Pr(S(t)  t  A)  -*■  Pr(S(®)  e  A)  for  all  A  c  A,  it  follows  that  Pr(R(S(t))  e  B)  •+ 
(B)),  for  all  Borel  sets.  Thus  if  E|R(S(»))|  <  »,  then  if  follows 

from  theorem  2  that: 

lim  /  R(S(x))dx  =  ER(S(®)) 

t-*™  0 


a.s.  and  in  expectation. 


(viii)  If  EV(t)  converges  then  EV(»)  must  be  its  limit,  since 
l  t 

EV(®)  =  lim  —  J  E(V(s))ds.  In  this  case  theorem  2  is  trivial.  However, 

t-*oo  z  o 

E(V(t))  may  not  converge  and  theorem  3  may  still  hold.  For  example,  let 
Xq  =  0,  and  let  F  e  G  have  an  atom  at  1,  Choose  a  regenerative  process 
V  so  that  E(V(t)|t  -  T  =  1/2)  *  *,  E(V(t)|t  -  T  /  1/2)  =  0.  Then 


clearly  FV(n  +  1/2)  ■  ®  for  all  n,  but  EV(»)  *  0. 

When  X0  ■  0,  a  necessary  and  sufficient  condition  for  convergence  of 
EV(t)  to  EV(»)  is  uniform  integrability  of  g(*)  =  E(V(t)[t  -  T^  »  •) 


with  respect  to  the  family  {F^,  t  >_  0),  where  Ft(x)  *  Pr(t  -  T^  <_  x)  * 

^  (t-x)'  * 

1  -  /  m(ds)(l  -  F(t-s)),  x  <  t 

0 


■ 


1 


x  >  t 
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